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AN INTRACONCEPT ANALYSIS . F RATIONAL NUMBER ADDITION: 
A VALIDATION STUDY 



A. Edward Uprichard and E. Ray Phillips 
University of South Florida 



In previous studies, researchers have attempted to generate learning hier** 
archies using task analysis based primarily on epistemological considerations 
(Gagne & Paradise, 1961; Gagne, 1962; Cox & Graham, 1966; Uprichard, 1970; Okey 
& Gagne, 1970; Harke, 1971^ Riban, 1971; Phillips h, Kane, 1973; Miller & Phillips, 
1975). Studies of this type conducted in the early sixties provide substantial 
evidence to support the hierarchical structure of knowledge (Gagne & Paradise, 
1961; Gague*& Brown, 1961; Gagne, 1962, 1963' Gagne, Mayor, Gars tens & Paradise, 
1962; Gagne & Staff, 1965). An examination of result^ from recent studies 
(Neidermeyer, Brown & Sulzen, 1969; Brown, 1970; Phillips & Kane, 1973; Callahan 
& Robinson, 1973) suggests that optimal learning sequences can be developed by 
sequencing instructional materials according to validated learning hierarchies. 
However, both Gagne (1968) and Pyatte (1969) have pointed out that the determi- 
nation of an optimal or hierarchical sequence of subtasks from simplest to most 
complex is not easily achieved. 

Numerous hierarchy validation techniques have appeared in the literature. 
Critical aftalyses of the efficacy of these techniques are also reported (Resnick 
fit.Wang, 1969; Eisenberg & Walbesser, 1971; White, 1973; White, 1974a, 1974b: 
Phillips, 1971, 1974). Many of these techniques are cqncemed with the analysis 
of data collected on hypothesized hierarchies. While there Is considerable room 

Portions of this paper were presented at the annual meeting of the Ameri- 
can Educational Research Association, Washington, D. C. , 1975. 



for improvement, techniques such as the Walbesser method (Walbesser, 1968) and 
Pattern analysis (Rimoldi & Grib, 1960) have been used effectively in validat- 
ing hypothesized hierarchies (Harke, 1971; Phillips & Kane, 1973; Miller & 
Phillips, 1975). 

The investigators in the present study were concerned with the generation 
and validation of an hypothesized learning hierarchy. More specifically, the 
purposes of the study were (1) to develop a learning hierarchy for rational 
number addition using the intraconcept analysis technique, and (2) to test the 
validity of the hypothesized hierarchy using the Walbesser Technique and Pattern 
Analysis. The objective in doing an intraconcept analysis is to generate a 
series of tasks, each of which represent an operationalized level of a given 
concept. This technique differs from the more widely used task analysis model 
in that consideration is given to both psychological and content (discipline) 
factors in developing arid hierarchically ordering tasks. Because of this, the 
authenticity of many tasks generated using the intraconcept analysis technique 
may be questioned by content area specialists. However, many educators (in- 
cluding the authors), who have worked in clinical situations with young children 
experiencing difficulty in learning mathematics question whether one can simply 
impose mathematical or adult logic on children. The present study was conducted 
in hopes of shedding^ some light on the epistemological-psychological balance 
needed in developing efficient or optimal instructional sequences in mathematics. 

PROCEDURE 

Development of Hierarchy 

The addition of rationals in fraction form was analyzed using an intracon- 
cept analysis technique. The specific strategy used in the analysis was as 
follows: 
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a) Problems were divided into two levels: Like Denominators/ and Unlike 

. Denominators. Classes within each level were identified by the nature 
of (prime and composite) and relationship between (multiple or not) 
denominators of the two rationals added. The classes > in their hypothe- 
sized order of difficulty, were: 
Like Denominators 

I. Composites. (1/4 + 2/4 » ) 

II. Primes. (1/5 + 1/5 - ) 

Unlike Denominators 

III. Composites- one composite multiple of other. (1/A + 1/8 = ) 

IV. Prime, composite- composite a multiple of prime. (1/5 + 1/10 = ) 

V. Primes. (1/5 + 1/7 « ) 

VI. Prime, composite- composite not multiple of prime. (1/5 + 1/9 = ) 

VII. Composites- not multiples. (1/6 + 1/8 = ) 

I ' 

b) Within each denominator class an attempt was; made to generate f iye sum 
categories.^ The sum categories were operatjionally defined in terms of 
renaming. The five categories in their hypij^thesized order of difficulty' 



were : 

I. Sum- proper fraction in simplest form without renaming. (1/4 + 2/4 = 

3/4), 

II. Sum- iniproper fraction renamed to one (1). (1/4 + 3/4 - 4/4 - 1) 

III. Sum- propeK fraction renamed to simplest form. (1/4 + 1/4 - Ilk = 1/2) 

\ 

IV. Sum- Improper rj^ctlon renamed to mixed numeral In simplest form, one renam- 
ing. (3/A + 2/A =^4 = 1 1/A) 

V. Sum- Improper fraction renamed to mixed numeral in simplest form, two 
renamings. (3/A + 3/A = 6/A « 1 2/A « 1 1/2) 



^Five sum categories do not exist in some .classes . 
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c) Two tasks involving mixed numerals (whole number sums less than or equal 
to nine) were associated with each sum category within a class. A sum 
category and its two related tasks is presented below. 

Sum Category I Task #1 Task #2 

1/4 + 2/4 « 1 1/4 -h 2/4 « 1 1/4 + 1 2/4 - 



Analysis of Hierarchy 

The procedure as described yielded eighty-nine specific tasks. In order 
to hold testing to a manageable size, some tasks within classes were collapsed. 
The final hierarchy consisted of 45 tasks includj|.ng (a) all existing sum cate- 
gories within identified classes and (b) a sampling of tasks involving mixed 
numerals within classes. Based upon the hypothesized ordering of the subordinate 
tasks, a test was constructed to assess mastery at each level in the hierarchy. 
"Pass'* was defined as correct sum expressed in simplest form. For ease in com- 
putation the tasks appeared in vertical form. 

The test was administered to 251 students in grades 4 through 8 in order 
to obtain a wide range of ability levels. The majority of the Ss were in grades 
5 and 6. Subjects who passed or failed all 45 items were excluded from the study 
since inferences about the order of items cannot be based on responses from these 
students (Phillips & Kane, 1975). The resulting sample contained 200 Ss. 

The patterns of responses for each_tr|aisfer in tlie hierarchy were analyzed 
using both the Walbesser Technique (Walbesser, 1968) and Pattern Analysis 
(Rimoldi & Grib, 1960). The Walbesser Technique is based on the 2 X 2 contin- 
gency table of pass-fail responses (Figure 1). 
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Item 1 



Item 2i 



pass (+) 



fail {-) 
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Figure 1. Contingency Table 
Using the frequency of students falling in each cell above, -the following three 
ratios were computed for every possible relationship in the hierarchy (i.e. 
level. 1 with 2, 1 with 1, ... 1 with 45; 2 with 3, 2 with 4, ... 2 with 45, etc.). 

(1) Consistency Ratio = (-Hf) 

(-H-) + (+-) 

The value of this ratio is a measure of how consistent the data are 
with the hypothesized dependency. 

(2) Adequacy Ratio « (-H-) 

(-H-) + (^) 

The value ^f this ratio is a measure of the adequacy of the identi- 
fied levels. 

• (3) Completeness Ratio » (-H-) 

(4+) + (~) 

The value of this ratio is a measure of the effectiveness of instruc- 
tion. 

The level of acceptability used for each of these ratios was that determined 
by Phillips (1971) instead of those proposed by Walbesser since no instructional 
sequences were involved. These levels are: (1) Consistency Ratio .85, (2) 
Adeqi ->cy Ratio .70, (3) Completeness Ratio .50. 

The pattern analysis technique was used to analyze the responses for the 
complete hierarchy on a subject by subject basis. The index of agreement given 
by the pattern analysis indicates the amount of agreement or correlation between 



two patterns. In this case» the index of agreement indicates the agreement 
between the observed and expected patterns. If the tasks were truly hierar- 
chical, where each subtajsk was a necessary prerequisite to the next» oftce a 

c 

learner failed a given level he would be expected to fail all subsequent lev- 
els. Thus, the expected pattern was defined as one vhere no correct responses 
followed an incorrect response. 

RESULTS ( 

The initial hypothesized hierarchy developed using an intraconcept an'al- 
ysis is given in Table 1. A computer program based on the Walbesser Technique 



Insert Table 1 About Here 



was used to give the pass-fail response patterns between all relationships* " 
That is, item 1 was paired with all 45 items; item 2 with all items; etc.; un- 
til all possible pairs of items were considered. 

Q 

In order to analyi:e the hypothesized hierarchical sequence, the consis- 
tency, adequacy, and completeness ratios for each relationship within the 
hierarchy were examined. No ordering of the 45 tasks yielded acceptable levels 
in all three ratios. The ordering which yielded the best fit to the data is 
shown in Table 2. 



Insert Table 2 About Here 



The pattern of responses obtained from the hypothesized ordering of sub- 
ordinate tasks yielded an index of agreement of .68. After final Prevision, 
the empirical sequence yielded an index of agreement of .70 which indicates a 
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slightly higher agreement between the expected and observed response patterns. 

e 

No statistical test of sig;iiflcance for the index of agreement has been de- 
veloped • 

The internal consistency of the test based on the initial hierarchy was 
determined using,, the Kuder-Rich^-dson Formula 20 (Nunnally, 1967). The value 
of this coefficient was .98. The pattern of responses for the empirical se- 
quence was analyzed to determine if the ordering exhibited a hierarchical 
structure based on item difficulty. Item difficulty of each task in the or- 
dered sequence is given in Table 3. Although there would be some discrepancies 



Insert Table 3 About Here 



between a hierarchical sequence based on item difficulty and the ordered se- 
quence determined, the general pattern of item difficulty of the latter is 
acceptable. Further, item difficulty alone is not considered an adequate 
technique for determining hierarchical relationships (Phillips, 1971). 

Since many task comparisons involving mixed numerals resulted in low 
Walbesser ratios (see Table 2) , an empirical sequence without mixed numerals 
was determined. The index of agreement for this sequence which is presented 
in Table 4 was .75. 

Insert Table 4 About Here^ 



DISCUSSION AND IMPLICATIONS 

An examination of data In Table 2 (Walbesser ratios) indicates that with 
few exceptions task comparisons meet specified criteria on two of the three 
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ratios. The conslsteucy ratio was met in 35 of 44 comparisons, the adequacy 
ratio In 43 of 44 » and the completeness ratio In only 27 of 44. It should be 
noted, however, that the first two ratios reported are more critical when de~ 
termlnlng a hierarchy from test data* A considerable Improvement In the number 
of comparisons meeting criteria on ratios was observed for the hierarchical 
sequence determined when tasks Involving mixed numerals were omitted (Consis- 
tency, 26/28; Adequacy, 28/28; and Completeness, 20/28; see Table 4). The 
Index o^ agreement for the twenty-nine task hierarchy (no mixed numerals) was 
greater than that of the forty-five task hierarchy .75 vs .70* This difference 
may be directly related to the number of tasks In each hierarchy* 

The empirically determined sequence Is presented In Table 5 In terms of 
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the defining characteristics of each task* An examination of the sequence 
tends to support the following Implications for teaching youngsters the addition 
of ratlonals In fraction form* 

1* Tasks Involving like denominators should be taught before thosa In- 
volving unlike denominators, with one exception-sum categox-y V. 
2* Ir4 working with like denominators one should ^ -^ach tasks within a 

given sum category before preceding to the next one* The sum categories 
In hierarchical order are I, II, IV, III, V. 
3* Within a sum category tasks Involving llke-composlte denominators 

should be taught before those with llke-prlme denominators. 
4* In working with unlike denominators, one should teach tasks within 
a given sum category before preceding to th« next one. The sum 
categories In hierarchical order are I, II, III, IV, V. 
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5. Tasks Involving adding with mixed numerals should not be Introduced 
early In the development \f rational number addition skills. 

6. Tasks Involving adding with two mixed numerals within a denominator 
class and sum category should be taught before those tasks involving 
one mixed numeral, 

7. Sequencing of unlike denominator classes Is difficult and not com- 
pletely determined b^ this study. However, a possible teaching se- 
quence might be III, IV, VI, V, VII, 

In general, the results of this study, though limited to the addition of 
rational numbers in fraction form, support the notion that both eplstemologl- 
cal and psychological factors be considered when .developing teaching sequences 
In mathematics • Some of the Implications above would not necessarily be de- 
rived from logical analysis alone. Also, In Interpreting the results of this 
study one must be conscientious of the limitations of Indirect validation pro- 
cedures. For example, confounding variables such as prior educational ex- 
perience of subjects and errors of measurement must be considered,' 
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TABES 1 

Initial Hypothesized Hierarchy 



1. 1/4 + 2/A ' 

2. 1/5 + 3/5 - 

3. 2 1/6 + A/6 - _ 

4. 3 1/8+4 2/8 - 

5. 1/4 + 3/4 - 

6. 3/7 + 4/7 - 

7. 1/6 + 1/6 - 

8. 5/8 + 4/8 - 

9. 2/3 + 2/3 - 

10. 4 3/5 + 4/5 - _ 

11. 5 3/7+1 5/7 - 

12. 3/4 + 3/4 - 

13. 2 3/6 + 5/6 - 

14. 6 5/8+2 5/8 - 

15. 1/3 + 1/9 - 

16. 1/4 + 1/8 - 

17. 2 1/12 + 2/4 - _ 

18. 3 1/8+5 1/16 - 

19. 1/3 + 1/5 - 

20. 1/5 + 8/10 - 

21. 3/4 + 3/12 - 

22. 1/3 + 2/6 - 

23. 1/4 + 2/3 - 

ERIC 



24. 3 2/5 + 2/10 » 

25. 4 1/3+3 3/9 - 

26. 2/3 + 3/6 - 

27. 5/8 + 7/10 - _ 

28. 2/3 + 3/5 - 

29. 5 3/5 + 3/7 - _ 

30. 3 1/2 +4 2/3- 

31. 2/3 + 6/9 - 

32. 3/4 + 4/8 » 

33. 1/3 + 1/10 - 

34. 2/6 + 3/7 - 

35. 1/4 + 1/6 - 

-36. 3/6 + 4/3 » 

37. 6 4/8 + 5/10 - 

38. 5 2/4+2 3/6 = 

39. 1/6 + 3/10 = _ 

40. 1/3 + 7/10 = _ 

41. 3/8 + 11/12 = _ 

42. 4/6 + 4/7 = 

43. 3 2/3 + 5/10 = _ 

44. 4 3/5+3 4/8 = 

45. 3/4 + 3/6 « 



TABLE 2 

Walbesser's Ratios for the Empirical Ordering (N«200) 

Level Consistency Adequacy Completeness 



1-2 


.98 


.96 


.97 


*2-4 


.95 


.76 


.97 


*A-5 


.85 


.84 


.83 


5-6 


.99 


.99 


.76 


6-8 


.98 


.84 


.73 


8-9 


,97 


.98 


.65 


9-7 


.86 


.85 


.69 


*7-ll 


.87 


.79 


.66 


*ll-3 


.70 


.70 


.67 


*3-10 


.72 


.60 


.60 


*i0-16 


.78 


.80 


.56 


16-15 


.95 


,93 


.59 


15-33 


.94 


.88 


.58 


33-19 


.93 


.94 


.55 


19-35 


.93 


.91 


.54 


35-20 


.9i 


.88 


.55 


20-21 


.96 


.94 


.56 


21-36 


.97 


.90 


.53 


36-12 


.83 


.83 


.51 


*12-14 


.90 


.90 


.51 


*14-13 


.94 


.96 


.51 


*13-23 


.81 


.88 


.52 


23-22 


.89 


.92 


.53 


22-39 ' 


.94 


.80 


.48 


39-3A 


.81 


.88 


.41 


3A-27 


.98 


.72 


.47 


27-26 


.95 


.97 


.54 


26-AO 


.95 


.90 


.52 


AO-28 


.85 


.89 


.49 


28-Al 


.89 


.80 


.46 


41-31 


.92 


.82 


.AS 


31-32 


.93 


.95 


.50 


32-A2 


.93 


.79 


.46 


*A2-18 


.90 


.73 


.48 


*18-25 


.93 


.76 


.48 


*25-17 


.60 


.78 


.35 


*17-24 


.61 


.73 


.32 


*24-30 


.77 


.94 


.44 


*30-38 


.94 


.92 


.48 


*38-44 


.88 


.81 


.41 


*44-29 


.88 


.79 


.42 


*29-37 


.87 


.81 


.42 


*43-45 


.74 


.85 


.36 



*lii<llcates comparison involving olxed numerals 
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TABLE 3 
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Item Difficulty-Empirical Hierarchy (45 Tasks) 


Task 


Difficulty 


- ^ - - 
Task 


Difficulty 


1 


.94 


.31 


.54 


2 


.91 


.32 


.53 


*4 


.74 


.42 


.43 


5 


.76 


*.18 


.55 


6 


.73 


*.25 


. 


8 


.64 


*.17 


.35 


9 


.66 


*.24 


.42 


7 


.64 


*.30 


.51 


*11 


.59 


*.38 


.50 


*3 


.61 


*.44 


.42 


*10 


.48 


*.29 


.47 


16 


.59 


*.37 


.46 


15 


.59 


*.43 


.38 


33 0 . 


.57 


.45 


.41 


19 


.57 






. 35 


.54 






20 


,58 






21 


.55 






36 


.53 






12 


.51 






*14 


.51 






*13 


.50 






23 


.55 






22 


.53 






39 


.46 






34 


.42 






27 


.56 






26 


.53 






40 


.51 






28 


.50 






41 


.47 







♦indicates problems involving mixed numerals 
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TABLE 4 



Walbesser's Ratios for the Empirical Ordering- No Mixed Nimerals (N-200) 
Level Consistency Adequacy Completeness 



1-2 


.98 


' .96 


.97 


2-5 


.95 


.76 


.96 


5-6 - 


.99 


.99 


.76 


6-8 


.98 


.84 


.73 


8-9 


.97 


.98 


.65 


9-7 


.86 


.85 


.69 


7-12 


.95 


.74 


,60 


12-16 


.76 


.86 


.56 


16-15 


.95 


.93 


,59 


15-33 


.94 


.88' 


.58 


33-19 


.93 


.94 


.55 


19-35 


.93 


.91 


.54 


35-20 


.94 


.88 


.55 


2C-21 


.96 


.94 


.56 


21-36 


.97 


.90 


.53 


36-23 


.92 


.87 


.53 


23-22 " 


.89 


.92 


.53 


22-39 


- .94 


.80 


.48 


39-34 


.81 


.88 


.41 


34-27 


.98 


.72 


.47 


27-26 


.95 


.97 


.54 


26-40 


.95 


.90 


• .52 


40-28 


.85 


.89 


.49 


28-41 


.89 


.80 


. .46 


41-31 


.92 


..82 


.46 


31-32 


.93 


.95 


,50 


32-45 


.93 


.79 


.46 


42-45 


.86 


.81 


.40 
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TABIS 5 

Btpirical Order of Tasks by Sum & Dencminator's 



Sun Categories 







(0 60 




0) c 




rH 




P. u 




B 0 




•H to 




(0 (0 


c 




o 




•H 


o 


4J 




O 


4J P 




o o 


c 




M-l O 


4J 


u o 




0) 4J 




a 


(1) A 


o 


g-e 






S- g 


^1 o 


B 




M C 


I 


II 



C 

0) 

eg 
o o 

4J 

U 4J 
(0 (0 
0) 

^ B 

0) 

P. CO 
O 

u o 



III 



k 

c 

0) 

u 



I 

c 

0) o 



4J 7 

o c 

^ 0) 
P. 

O O 

u u 

H 0) CO 



IV 



4J 

CO 



t)0 



L w 

e I 60 

^ B C 

0) CO 6 



o 



4J ? 3 
O C 

Vi f-J o 

0) 6 ^ 
p. 

O O 4J 

u u tn 

pu 0) 

W QJ P- 



Composltes 



20 



a* One mixed numeral 



in 



22 



b» Two mixed numerals 



II > Primes 



^ One mixed numeral 



b* Two mixed numerals 



CO 

CO 
CO 

< 
a 

o 
< 

M 

o 
c 



III. 



Composites - one com- 
posite multiple of 
other. 



12 



18 



23 



a. One m ixed numeral 



Two mixed nnmprals 



IV. Prime, Composite - 

composite multiple of 
prime* 



13 



17 



2^ 



a. One mixed numeral 



b. Two mixed numerals 



V. Primes 



27 



28 



30 



33 



32 



a. One mixed numeral 



b. Two mixed numerals 



J5_ 



VI. Prime, Composite • 

composite not multiple 
of prime. 



14 



26 



a. One mixed numeral 



29 



3A 



A3 



b* Twc mixed numerals 



Al 



VII. Composites - not 
multiples 



16 



19 



21 



A5 



a. OtVi ^ 1l^ypt^ nnmpral 



b. Two mixed numberals 



AO 



^Numerals in table do not correspond to test items. 
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